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' The order statistics based list decoding techniques for Hnear binary block codes of small to medium 

Ch \ block length are investigated. The construction of the list of the test error patterns is considered. 

The original order statistics decoding is generalized by assuming segmentation of the most reliable 
independent positions of the received bits. The segmentation is shown to overcome several drawbacks 
of the original order statistics decoding. The complexity of the order statistics based decoding is further 
reduced by assuming a partial ordering of the received bits in order to avoid the complex Gauss 
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C/3 , ehmination. The probability of the test error patterns in the decoding list is derived. The bit error 

rate performance and the decoding complexity trade-off of the proposed decoding algorithms is studied 
by computer simulations. Numerical examples show that, in some cases, the proposed decoding schemes 
l/^ ' are superior to the original order statistics decoding in terms of both the bit error rate performance as 

(N '. 

, well as the decoding complexity. 
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I. Introduction 

A major difficulty in employing forward error correction (FEC) coding is the implementation 
complexity especially of the decoding at the receiver and the associated decoding latency for 
long codewords. Correspondingly, the FEC coding is often designed to trade-off the bit error rate 
(BER) with the decoding complexity and latency. Many universal decoding algorithms have been 
proposed for the decoding linear binary block codes Q. The decoding algorithms in jSl- [[TT| 
are based on the testing and re-encoding of the information bits as initially considered by Dorsch 
in [|2l. In particular, a list of the likely transmitted codewords is generated using the reliabilities 
of the received bits, and then, the most likely codeword is selected from this list. The list of the 
likely transmitted codewords can be constructed from a set of the test error patterns. The test 
error patterns can be predefined as in Q and flU and in this paper, predefined and optimized 
for the channel statistics as in |l5l, or defined adaptively for a particular received sequence as 
suggested in [6]. The complexity of the list decoding can be further reduced by the skipping 
and stopping rules as shown, for example, in Q and O. 

Among numerous variants of the list decoding techniques, the order statistics decoding (OSD) 
is well-known [[3l, flU. The structural properties of the FEC code are utilized to reduce the 
OSD complexity in [|71. The achievable coding gain of the OSD is improved by considering 
the multiple information sets in 18]. The decoding proposed in ^ exploits randomly generated 
biases to present the decoder with the multiple received soft-decision values. The sort and match 
decoding of [10] divides the received sequence into two disjoint segments. The list decoding 
is then performed for each of the two segments independently, and the two lists are combined 
using the sort and match algorithm to decide on the most likely transmitted codeword. The box 
and match decoding strategy is developed in ifTTI . An alternative approach to the soft-decision 
decoding of linear binary block codes relies on the sphere decoding techniques [fT2|. lfT3l . For 
example, the input sphere decoder (ISD) discussed in this paper can be considered to be a trivial 
sphere decoding algorithm. 

In this paper, we investigate the OSD-based decoding strategies for linear binary block codes. 
Our aim is to obtain low-complexity decoding schemes that provide sufficiently large or valuable 
coding gains, and most importantly, that are well-suited for implementation in communication 
systems with limited hardware resources, e.g., at nodes of the wireless sensor network. We 
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modify the original OSD by considering the disjoint segments of the most reliable independent 
positions (MRIPs). The segmentation of the MRIPs creates flexibility that can be exploited to 
fine tune a trade-off between the BER performance and the decoding complexity. Thus, the 
original OSD can be considered to be a special case of the segmentation-based OSD having 
only one segment corresponding to the MRIPs. Since the complexity of obtaining a row echelon 
form of the generator matrix for every received codeword represents a significant part of the 
overall decoding complexity, we examine a partial-order statistics decoding (POSD) when only 
the systematic part of the received codeword is ordered. 

This paper is organized as follows. System model is described in Section II. Construction of the 
list of test error patterns is investigated in Section III. The list decoding algorithms are developed 
in Section IV. The performance analysis is considered in Section V. Numerical examples to 
compare the BER performance and the decoding complexity of the proposed decoding schemes 
are presented in Section VI. Finally, conclusions are given in Section VII. 

II. System Model 

Consider transmission of codewords of a linear binary block code C over an additive white 
Gaussian noise (AWGN) channel with Rayleigh fading. The code C, denoted as (A^, K, dram), has 
block length A^, dimension K, and the minimum Hamming distance between any two codewords 
dmiri- Binary codewords c G where Z2 = {0, 1} are generated from a vector of information 
bits u G Zf- using the generator matrix G G Z^^^, i.e., c = uG, and all binary operations 
are considered over a Galois field GF(2). If the code C is systematic, the generator matrix 
has the form, G = [I P], where I is the K x K identity matrix, and P G Zg^^^^"^-* is the 
matrix of parity checks. The codeword c is mapped to a binary phase shift keying (BPSK) 
sequence x G {+1,-1}^ before transmission using a mapping, Xi = Ai (q) = (—1)'^% for 
i = 1,2, ■ ■ ■ , N. Assuming bits Ui and Uj, the mapping Ai has the property, 

M {ui © Uj) = M (ui) M (uj) (1) 

where © denotes the modulo 2 addition. The encoded bit Cj can be recovered from the symbol 
Xi using the inverse mapping, q = A^~^ (xj) = (1 — Xj)/2. For brevity, we also use the notation, 
X = (c) and c = A^^^ (x), to denote the component- wise modulation mapping and de- 
mapping, respectively. The code C is assumed to have equally probable values of the encoded 
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bits, i.e., the probability, Pr{cj = 0} = Prjcj = 1} = 1/2, for i = 1, 2, ■ ■ ■ , A^. Consequently, 
all the codewords are transmitted with the equal probability, i.e., Pr{c} = 2~^ for Vc G C. 
The signal at the output of the matched filter at the receiver can be written as, 

yi = hiXi + Wi 

where the frequency non-selective channel fading coefficients hi as well as the AWGN samples Wi 
are mutually uncorrelated zero-mean circularly symmetric complex Gaussian random variables. 
The variance of hi is unity, i.e., E[|/iip] = 1 where E[-] is expectation, and | ■ | denotes the 
absolute value. The samples Wi have the variance, E[|u;ip] = (i?7c)~^, where R = K/N is 
the coding rate of C, and 7c is the signal-to-noise ratio (SNR) per transmitted encoded binary 
symbol. The covariance, E^/ij/i*] = for i 7^ j, where (■)* denotes the complex conjugate, 
corresponds to the case of a fast fading channel with ideal interleaving and deinterleaving. For 
a slowly block-fading channel, the covariance, E^/ij/i*] = 1 for Vz,j = 1,2, ■■■ ,A^, and the 
fading coefficients are uncorrelated between transmissions of adjacent codewords. 

In general, denote as /(■) the probability density function (PDF) of a random variable. The 
reliability rj of the received signal corresponds to a ratio of the conditional PDFs of y^ llT4l . 
i.e.. 



f{.yi\xi 









oc Re{h*yi} = ri 



since the PDF f{yi\xi, hi) is conditionally Gaussian. Thus, the reliability can be written as, 

ri = Re{hi} Re{yi} + lm{hi} lm{yi} = \hi\'^Xi + \hi\wi. 
The bit-by-bit quantized (i.e., hard) decisions are then defined as, 

Ci = (sign(rj)) 

where sign(-) denotes the sign of a real number. 

More importantly, even though the primary metric of our interest is the BER performance 
of the code C, it is mathematically more convenient to obtain and analyze the list decoding 
algorithms assuming the probability of codeword error. Thus, we assume that the list decoding 
with a given decoding complexity obtained for the probability of codeword error will also have 
a good BER performance. The maximum likelihood (ML) decoder minimizing the probability 
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of codeword error provides the decision Cml on the most likely transmitted codeword, i.e., 

Cml = argmin ||y-h0x||^ 

ceC: x=A^(c) 

N 

= argmaxN^ Re{|/j/i*x*} = argmax r-x (2) 

C6C .^^ ceC: x=M{c) 

where y, h, x, and r denote the A^-dimensional row vectors of the received signals yi, the 
channel coefficients hi, the transmitted symbols Xi, and the reliabilities within one codeword, 
respectively, ||-|| is the Euclidean norm of a vector, is the component- wise (Hadamard) product 
of vectors, and the binary operator ■ is used to denote the dot-product of vectors. The codewords 
c E C used in Q to find the maximum or the minimum value of the ML metric are often referred 
to as the test codewords. In the following subsection, we investigate the soft-decision decoding 
algorithms with low implementation complexity to replace the computationally demanding ML 
decoding Q. 

A. List Decoding 

We investigate the list-based decoding algorithms. For simplicity, we assume binary block 
codes that are linear and systematic ifTSl . We note that whereas the extension of the list-based 
decoding algorithms to non-systematic codes is straightforward, the list based decoding of non- 
linear codes is complicated by the fact that the list of the test codewords is, in general, dependent 
on the received sequence. The decoding (time) complexity O of the list decoding algorithms 
can be measured as the list size given by the number of the test codewords that are examined 
in the decoding process. Thus, the ML decoding (O has the complexity, 0ml = 2^, which is 
prohibitive for larger values of K. Among the practical list-based decoding algorithms with the 
acceptable decoding complexity, we investigate the order statistics decoding (OSD) ^ based 
list decoding algorithms for soft-decision decoding of linear binary block codes. 

The OSD decoding resumes by reordering the received sequence of reliabilities as, 

|r;| > |f^| > ■■■Ir^vl (3) 

where the tilde is used to denote the ordering. This ordering of the reliabilities defines a 
permutation. A', i.e.. 
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The permutation A' corresponds to the generator matrix G' = A'[G] having the reordered 
columns. In order to obtain the most reliable independent positions (MRIPs) for the first K 
bits in the codeword, additional swapping of the columns of G' may have to be used which 



G' 



. The matrix G" can 



corresponds to the permutation A", and the generator matrix G" = A" 
be manipulated into a row (or a reduced row) echelon form using the Gauss (or the Gauss- 
Jordan) elimination. To simplify the notation, let f and G denote the reordered sequence of the 
reliabilities r and the reordered generator matrix G in a row (or a reduced row) echelon form, 
respectively, after employing the permutations A' and A", to decode the received sequence y. 
Thus, for i > j, the reordered sequence f has elements, |fj| > \fj\, for i, j = 1, ■ ■ ■ , K, and for 
z,j = K + l,--- ,iV. 

The complexity of the ML decoding Q of the received sequence y can be reduced by assuming 
a list of the L test codewords, so that L <^ 2^ . Denote such a list of the test codewords of 
cardinality L generated by the matrix G as, Sl = {eo,e2, ■ ■ ■ ,6^1}, and let eo = be the 
all-zero codeword. Then, the list decoding of y is defined as, 

c = argmax f ■ x (4) 

eefi: x=A4(co®e) 

where the systematic part of the codeword Cq is given by the hard-decision decoded bits at 
the MRIPs. The decoding step to obtain the decision Cq is referred to as the 0-th order OSD 
reprocessing in Q. In addition, due to linearity of C, we have that (cq © e) G C, and thus, the 
test codewords e. E Sl can be also referred to as the test error patterns in the decoding dH). 
Using the property ([T]), we can rewrite the decoding ^ as, 

c = argmax f ■ xq ■ (e) = argmax fo ■ (e) (5) 

where we denoted xq = (co) and fo = fOxQ. The system model employing the list decoding 
([5]) is illustrated in Fig. [IJ More importantly, as indicated in Fig. [H the system model can be 
represented as an equivalent channel with the binary vector input c and the vector soft-output 
fo- 



III. List Selection 

The selection of the test error patterns e to the list 8l as well as the list size L have a 
dominant effect upon the probability of incorrect codeword decision by the list decoding. Denote 
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such probability of codeword error as Pc, and let Ctx be the transmitted codeword. In [,12.1 . the 
probability Pc is expanded as, 

Pe = Pr{c ^ Ctx|cml 7^ Ctx} Pr{cML 7^ Ctx} 
+Pr{c 7^ Ctx|cml = Ctx} Pr{cML = Ctx} 

where the decision c is obtained by the decoding ([5]), and the condition, cml ctx, is true 
provided that the vectors Cml and Ctx differ in at least one component, i.e., Cml = Ctx if 
and only if all the components of the vectors are equal. Since, for any list the probability, 
Pr{c 7^ ctx|cml 7^ ctx} = 1, and usually, the probability, Pr{cML = ctx} is close to 1, Pe can 
be tightly upper-bounded as, 

Pc < Pr{cML 7^ Ctx} + Pr{c ^ Ctx|cml = Ctx} • (6) 

The first term on the right hand side of Q is the codeword error probability of the ML decoding, 
and the second term is the conditional codeword error probability of the list decoding. The 
probability, Pr{c ^ Ctx|cml = Ctx}j is decreasing with the list size. In the limit of the maximum 
list size when the list decoding becomes the ML decoding, the bound Q becomes, Pe = 
Pr{cML 7^ Ctx}- The bound Q is particularly useful to analyze the performance of the list 
decoding ([5]). However, in order to construct the list of the test error patterns, we consider the 
following expansion of the probability Pc, i.e., 

Pe = Pr{c 7^ Ctx|(CTx©Co) G £L}Pr{(CTx©Co) G £l} 

+Pr{c ^ CtxKctx © Co) i ^L}Pr{(cTx © Co) i Sl) 
= 1 - Pr{c = CtxKctx © Co) G £l} Pr{(cTx © Co) G £l} ■ 

Pi Pii 

Using dH) and (|5]), the probability Pj that the list decoding ([5]) selects the transmitted codeword 
provided that such codeword is in the list (more precisely, provided that the error pattern Ctx©Co 
is in the list) can be expressed as, 

Pi = Pr{f ■ M (ctx © Co) > fo ■ -M (e) , Ve G 8l} ■ (7) 

The probability ([7]) decreases with the list size, and, in the limit of the maximum list size 
L = 2^^, Pi = 1 — Pc. On the other hand, the probability Pn that the transmitted codeword is 
in the decoding list increases with the list size, and Pn = 1, for L = 2^ . 
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Since the coding C and the communication channel are linear, then, without loss of generality, 
we can assume that the all-zero codeword, Ctx = 0, is transmitted. Consequently, given the list 
decoding complexity L, the optimum list minimizing the probability Pc is constructed as. 



where l^"] is the cardinality of the test list S, and the hard-decision codeword Cq G C represents 
the error pattern observed at the receiver after transmission of the codeword ctx = 0. For a given 
list of the error patterns S in ([8]), and for the system model in Section II with asymptotically large 
SNR, the probability Pj = Pr{c = 0|co G £} is dominated by the error events corresponding 
to the error patterns with the smallest Hamming distances. Since the error patterns are also 
codewords of C, the smallest Hamming distance between any two error patterns in the list 
£ is at least dmin- Assuming that the search in ([8]) is constrained to the lists £ having the 
minimum Hamming distance between any two error patterns given by (imin^ the probability Pj is 
approximately constant for all the lists £, and we can consider the suboptimum list construction. 



The list construction ^ is recursive in its nature, since the list £ maximizing dH) consists of the 
L most probable error patterns. However, in order to achieve a small probability of decoding 
error Pe and approach the probability of decoding error, Pr{cML 7^ ctx}, of the ML decoding, 
the list size L must be large. We can obtain a practical list construction by assuming the L 
sufficiently probable error patterns rather than assuming the L most likely error patterns. We 
restate Theorem 1 and Theorem 2 in jSl to obtain the likely error patterns and to define the 
practical list decoding algorithms. 

Denote as P(zi, ^2, ■ " " ? ^n) the n-th order joint probability of bit errors at bit positions 1 < 
ii < i2 <■■■< in < N in the received codeword after the ordering A' and A" and before the 
decoding. Since the test error pattern e is a codeword of C, the probability P(zi, «2, ■ ■ ■ , in), for 
in < K, is equal to the probability Pr{e = Cq} assuming that the n bit errors occurred during 
the transmission corresponding to the positions (after the ordering) ii,i2, - ■ ■ ,in- We have the 
following lemma. 

Lemma 1: For any bit positions Xi C X C {1, 2, ■ ■ ■ , A^}, 



£1 = argmaxPrjc = 0|co G £'}Pr{co G £} 

£: \£\=L 



(8) 



£l = argmaxPrjco G £} . 

£: \£\=L 



(9) 



P(X) < P(Xi). 
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Proof: The lemma is proved by noting that P(X) = P(Ii,X\Xi) = P(X\Xi|Xi)P(Xi) < 
min{P(Xi), P(X\Xi|Xi)} < P(Xi) where X\Xi denotes the difference of the two sets. ■ 
Using Lemma [H we can show, for example, that, P(i,j) < P(«) and P(i,j) < P(j)- We can 
now restate Theorem 1 and Theorem 2 in Q as follows. 

Theorem 1: Assume bit positions l<i<j<k<N, and let the corresponding reliabilities 
be |fj| > \fj\ > |ffc|. Then, the bit error probabilities, 

P(0 < P(J) 
P(z,j) < F{z,k). 

Proof: Without loss of generality, we assume that the symbols 1 and 

Xk = —1 have been transmitted. Then, before the decoding, the received bits would be decided 
erroneously if the reliabilities f,j > 0, fj > 0, and > 0. Conditioned on the transmitted 
symbols, let /(■) denote the conditional PDF of the ordered reliabilities fi, fj and fk- 

Consider first the inequality F{i) < P(j). Since, for f,/ > 0, /(fj) < f{—fi), using f{fi,fj) = 
f{fi\fj)f{fj), we can show that, for fj > and any fj, f{fi,fj) < f{—fi,fj). Similarly, 
using f{—fi,fj) = f{fj\ — fi)f{—fi), we can show that, for fj > and any fj, f{—fi,fj) < 
f{—fi, —fj). Then, the probability of error for bits i and j, respectively, is. 



P(0 = / / f{ri,rj)drjdri 
Jo J-fi 

/•oo rri roo rO 

= f{fi,fj)dfjdfi+ / / f{fi,fj)dfjdfi 

Jo Jo Jo J-fi 

/CO p\fi\ 
/ f{fufj)dfjdfi 
■oo ^0 

POO pfi POO pO 

= f{fi,fj)dfjdfi+ / / f{-fi,-fj)dfjdfi 

Jo Jo Jo J-fi 

and thus, P{i) < P(j). 

The second inequality, P(i,j) < P{i,k), can be proved by assuming conditioning, P(«,j) = 
P(j|z)P(z), P{i,k) = F{k\i)F{i), and f{fufj,fk) = fifj,fk\fi)f{fi), and by using inequality 
P(^) < P(j)> and following the steps in the first part of the theorem proof. ■ 
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IV. List Decoding Algorithms 

Using Theorem 1 and Theorem 2 in (31, the original OSD assumes the following list of error 
patterns, 

£l = {eG : < WH[e] < /, e G Zf } (10) 

where / is the so-called reprocessing order of the OSD, and wii[e] is the Hamming weight of 
the vector e. The list (flOl) uses a fT-dimensional sphere of radius / defined about the origin 
= (0, ■ ■ ■ , 0) in Z2 . The decoding complexity for the list (fTOl) is L = X]f=o (T) where / is 
referred to as the phase of the order / reprocessing in [3]. Assuming an AWGN channel, the 
recommended reprocessing order is / = [(iniin/4] ^ K where [■] is the ceiling function. Since 
the OSD algorithm may become too complex for larger values of / and K, a stopping criterion 
for searching the list Sl was developed in [|71. 

We can identify the following inefficiencies of the original OSD algorithm. First, provided 
that no stopping nor skipping rules for searching the list of the test error patterns are used, 
once the MRIPs are found, the ordering of bits within the MRIPs according to their reliabilities 
becomes irrelevant. Second, whereas the BER performance of the OSD is modestly improving 
with the reprocessing order I, the complexity of the OSD increases rapidly with / Thus, 
for given K, the maximum value of / is limited by the allowable OSD complexity to achieve 
a certain target BER performance. We can address the inefficiencies of the original OSD by 
more carefully exploiting the properties of the probability of bit errors given by Lemma [U and 
Theorem \T\ Hence, our aim is to construct a well-defined list of the test error patterns without 
considering the stopping and the skipping criteria to search this list. 

Recall that the error patterns can be uniquely specified by bits in the MRIPs whereas the bits 
of the error patterns outside the MRIPs are obtained using the parity check matrix. In order to 
design a list of the test error patterns independently of the particular generator matrix of the 
code as well as independently of the particular received sequence, we consider only the bit errors 
within the MRIPs. Thus, we can assume that, for all error patterns, the bit errors outside the 
MRIPs affect the value of the metric in ^ equally. More importantly, in order to improve the 
list decoding complexity and the BER performance trade-off, we consider partitioning of the 
MRIPs into disjoint segments. This decoding strategy employing the segments of the MRIPs is 
investigated next. 



IEEE TRANSACTIONS ON INFORMATION THEORY 



10 



A. Segmentation-Based OSD 

Assuming Q disjoint segments of the MRIPs, the error pattern e corresponding to the K 
MRIPs can be expressed as a concatenation of the Q error patterns e*^'') of length Kg bits, 
q = !,■■■ ,Q, i.e., 

e=(eW,...,e(«))GZf 

so that Ylq=i^<i — ^^'^ ^H[e] = u^nfe^^^] + ■■■ + u^nfe'^'^)]. As indicated by Lemma [T] 
and Theorem [H more likely error patterns have smaller Hamming weights and they correct 
the bit positions with smaller reliabilities. In addition, the decoding complexity given by the 
total number of error patterns in the list should grow linearly with the number of segments Q. 
Consequently, for a small number of segments Q, it is expected that a good decoding strategy is 
to decode each segment independently, and then, the final decision is obtained by selecting the 
best error (correcting) pattern from each of the segments decodings. In this paper, we refine this 
strategy for Q = 2 segments as a generalization of the conventional OSD having only Q = 1 
segment. 

Assuming that the two segments of the MRIPs are decoded independently, the list of error 
patterns can be written as, 

^i = 4>4'J (11) 

where S^^ and S^^ are the lists of error patterns corresponding to the list decoding of the first 
segment and of the second segment, respectively, and L = Li + L2. Obviously, fewer errors, 
and thus, fewer error patterns can be assumed in the shorter segments with larger reliabilities 
of the received bits. Similarly to the conventional OSD having one segment, for both MRIPs 
segments, we assume all the error patterns up to the maximum Hamming weight Ig, q = 1,2. 
Then, the lists of error patterns in (fTTI) can be defined as, 

= {{e,0)G: 0<wn[e]<I„ eeZ^^} ^^^^ 
£^^l = {(0,e)G: 0<u.H[e]</2, eeZf^}. 
The decoding complexity of the segmentation-based OSD with the lists of error patterns defined 
in (fni) is. 



where K = Ki + K2, and we assume Ji ^ Ki and I2 <^ K2. 
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Recall that the original OSD, denoted as OSD(/), has one segment of length K bits, and that 
the maximum number of bit errors assumed in this segment is /. The segmentation-based OSD 
is denoted as 0SD(/i,/2), and it is parametrized by the segment length A'l, and A'2, and the 
maximum number of errors Ji and I2, respectively. The segment sizes Ki and K2 are chosen 
empirically to minimize the BER for a given decoding complexity and for a class of codes under 
consideration. In particular, for systematic block codes of block length < 128 and of rate 
R> 1/2, we found that the recommended length of the first segment is, 

Ki ^ 0.35K 

so that the second segment length is K2 = K — Ki. The maximum number of bit errors Ji and I2 
in the two segments are selected to fine-tune the BER performance and the decoding complexity 
trade-off. For instance, we can obtain the list decoding schemes having the BER performance as 
well as the decoding complexity between those corresponding to the original decoding schemes 
OSD(/) and OSD(/ + 1). 

Finally, we note that it is straightforward to develop the skipping criteria for efficient searching 
of the list of error patterns in the OSD-based decoding schemes. In particular, one can consider the 
Hamming distances for one or more segments of the MRIPs between the received hard decisions 
(before the decoding) and the temporary decisions obtained using the test error patterns from 
the list. If any or all of the Hamming distances are above given thresholds, the test error pattern 
can be discarded without re-encoding and calculating the corresponding Euclidean distance. For 
the Q = 2 segments OSD, our empirical results indicate that the thresholds for the first and the 
second segments should be 0.35 dmin and dmin, respectively. 

B. Partial-Order Statistics Decoding 

The Gauss (or the Gauss-Jordan) elimination employed in the OSD-based decoding algorithms 
represents a significant portion of the overall implementation complexity. A new row (or a 
reduced row) echelon form of the generator matrix must be obtained after every permutation A" 
until the MRIPs are found. Hence, we can devise a partial-order statistics decoding (POSD) that 
completely avoids the Gauss elimination, and thus, it further reduces the decoding complexity 
of the OSD-based decoding. The main idea of the POSD is to order only the first K received 
bits according to their reliabilities, so that the generator matrix remains in its systematic form. 
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The ordering of the first K received bits in the descending order can improve the coding gain 
of the segmentation-based OSD. Assuming Q = 2 segments, we use the notation POSD(/i, I2). 
The parameters Ki, K2, h and I2 of P0SD(/i,/2) can be optimized similarly as in the case 
of OSD(/i, I2) to fine-tune the BER performance versus the implementation complexity. On the 
other hand, we will show in Section V that the partial ordering (i.e., the ordering of the first K 
out of N received bits) is irrelevant for the OSD decoding having one segment of the MRIPs 
and using the list of error patterns (flOl) . In this case, the POSD(/) decoding can be referred to 
as the input-sphere decoding ISD(/). 

C. Implementation Complexity 

We compare the number of binary operations (BOPS) and the number of floating point oper- 
ations (FLOPS) required to execute the decoding algorithms proposed in this paper. Assuming a 
(A^, K, (imin) code, the complexity of the OSD and the POSD are given in Table U and Table UIl 
The implementation complexity expressions in Table |I] for OSD(/) are from the reference S. 
For example, the OSD decoding of the BCH code (128, 64, 22) requires at least 1152 FLOPS and 
528448 BOPS to find the MRIPs and to obtain the corresponding equivalent generator matrix 
in a row echelon form. All this complexity can be completely avoided by assuming the partial 
ordering in the POSD decoding. The number of the test error patterns is L = 2080 for 0SD(2), 
and L = 1177 for OSD(2,2) with Ki = 21 and K2 = 43 whereas the coding gain of 0SD(2) 
can be only slightly better than the coding gain of 0SD(2, 2); see, for example. Fig. IH Hence, 
the overall complexity of the OSD-based schemes can be substantially reduced by avoiding the 
Gauss (Gauss-Jordan) elimination. 

V. Performance Analysis 

Recall that we assume a memory less communication channel as described in Section II. We 
derive the probability Pr{co G Sl} in ^ that the error pattern Cq observed at the receiver 
after transmission of the codeword ctx = is an element of the chosen decoding list £l- The 
derivation relies on the following generalization of Lemma 3 in [3]. 

Lemma 2: For any ordering of the received bits, consider the / bit positions X C {1, 2, ■ ■ ■ , A^}, 
and the (/) subsets Xi C X of Ji < / < A^ bit positions. Then, the total probability of the Ji 
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bit errors within the I bits can be calculated as, 




where po is the probability of bit error corresponding to the bit positions X. 

Proof: The ordering of the chosen / bits given by the set X is irrelevant since all subsets 
Xi of Ii errors within the / bits X are considered. Consequently, the bit errors in the set X can 



Using Lemma [2l we observe that the lists of error patterns (flOl) and (fT2l) are constructed, so that 
the ordering of bits within the segments is irrelevant. Then, the bit errors in a given segment can 
be considered to be conditionally independent. This observation is formulated as the following 
corollary of Lemma [2l 

Corollary 1: For the OSD(/) and the list of error patterns (fTO)) . the bit errors in the MRIPs 
can be considered as conditionally independent. Similarly, for the P0SD(Ji,J2) and the list 
of error patterns (fT2l) . the bit errors in the two segments can be considered as conditionally 
independent. 

Thus, the bit errors in Corollary [T] are independent conditioned on the particular segment being 
considered as shown next. 

Let Po be the bit error probability of the MRIPs for the OSD(J) decoding. Similarly, let Pi 
and P2 be the bit error probabilities in the first and the second segments of the 0SD(/i,/2) 
decoding, respectively. Denote the auxiliary variables, vi = jr/^J, V2 = \fKi+i\, and = |rA'+i| 
of the order statistics ([3]), and let u = \ri\, i = 1,2, ■ ■ ■ , K. Hence, always, vi > 112, and, for 
simplicity, ignoring the second permutation A", also, V2 > fs. The probability of bit error Pq for 
the MRIPs is calculated as. 



where E„[-] denotes the expectation w.r.t. (with respect to) u, fv^iy) is the PDF of the (fC + l)-th 
order statistic in ([3]), and Fu{v) is the cumulative distribution function (CDF) of the magnitude 
(the absolute value) of the reliability of the received bits (before ordering). Similarly, the 
probability of bit error Pi for the first segment is calculated as. 



be considered to be independent having the equal probability denoted as Pq. 
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where fviiv) is the PDF of the {Ki + l)-th order statistic in ([3]). The probability of bit error P2 
for the second segment is calculated as, 



where fvi{v) and Fy-^{v') is the PDF and the CDF of the Jii-th order statistic in ([3]), respectively. 
The values of the probabilities Pq, Pi and P2 have to be evaluated by numerical integration. 
Finally, we use Lemma [2] and substitute the probabilities Pq, Pi and P2 for po to calculate the 
probability Pr{co G £l} of the error patterns in the list E^. 



We use computer simulations to compare the BER performances of the proposed soft-decision 
decoding schemes. All the block codes considered are linear and systematic. 

The BER of the (31, 16, 7) BCH code over an AWGN channel is shown in Fig. [2] assuming 
ISD(2) and ISD(3) with K = 16 having 137 and 697 test error patterns, respectively, and 
assuming P0SD(1, 3) and P0SD(2, 3) with Ki = 6 and K2 = 10 having 183 and 198 test error 
patterns, respectively. We observe that P0SD(1, 3) achieves the same BER as ISD(3) while using 
much less error patterns which represents the gain of the ordering of the received information 
bits into two segments. At the BER of 10~\ P0SD(1,3) outperforms ISD(2) by 1.1 dB using 
approximately 50% more test error patterns. Thus, the P0SD(1,3) decoding provides 2.3 dB 
coding gain with the small implementation complexity at the expense of 2 dB loss compared to 
the ML decoding. 

Fig. Il shows the BER of the (63,45, 14) BCH code over an AWGN channel. The number 
of test error patterns for the ISD(2), ISD(3), P0SD(1,3) and 0SD(2) decodings are 1036, 
15226, 5503 and 1036, respectively. We observe from Fig. [3] that ISD(3) has the same BER as 
P0SD(1, 3) with two segments of A'l = 13 and A'2 = 32 bits. However, especially for the high 
rate codes (i.e. of rates greater than 1/2), one has to also consider the complexity of the Gauss 
elimination to obtain the row echelon form of the generator matrix for the OSD. For example, 
the Gauss elimination for the (63, 45, 14) code requires approximately 20, 400 BOPS; cf. Table HI 

The BER of the (128, 64, 22) BCH code over an AWGN channel is shown in Fig. H assuming 
OSD(l) and 0SD(2) with K = 64, and assuming OSD(2,2) with Ki = 21 and K2 = 43. The 
number of test error patterns for the OSD(l), 0SD(2) and OSD(2,2) decodings are 64, 2081 




VL Numerical Examples 
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and 1179. A truncated union bound of the BER in Fig. |4]is used to indicate the ML performance 
lfT4l Ch. 10]. We observe that both 0SD(2) and 0SD(2, 2) have the same BER performance for 
the BER values larger than 10"^, and 0SD{2) outperforms 0SD(2, 2) by at most 0.5 dB for the 
small values of the SNR. Our numerical results indicate that, in general, 0SD(2, 2) decoding can 
achieve approximately the same BER as 0SD(2) for small to medium SNR while using about 
50% less error patterns. Thus, a slightly smaller coding gain (less than 0.5dB) of OSD(2,2) in 
comparison with 0SD(2) at larger values of the SNR is well-compensated for by the reduced 
decoding complexity. More importantly, 0SD(2, 2) can trade-off the BER performance and the 
decoding complexity between those provided by OSD(l) and 0SD(2), especially at larger values 
of SNR. 

The BER of the (31, 16, 7) BCH code over a fast Rayleigh fading channel is shown in Fig. [51 
We assume the same decoding schemes as in Fig. |2l The P0SD(1,3) decoding with 183 error 
patterns achieves the coding gain of 17 dB over an uncoded system, the coding gain of 4 dB over 
ISD(2) with 137 error patterns, and it has the same BER as 0SD(3) with 697 error patterns. 
The BER of the high rate BCH code (64, 57, 4) over a fast Rayleigh channel is shown in Fig. [6l 
In this case, the number of test error patterns for the ISD(2), ISD(3), P0SD(2, 3) and 0SD(2) 
decoding is 1654, 30914, 8685 and 1654, respectively. We observe that, for small to medium 
SNR, P0SD(2, 3) which does not require the Gauss elimination (corresponding to approximately 
3,000 BOPS) outperforms 0SD(2) by IdB whereas, for large SNR values, these two decoding 
schemes achieve approximately the same BER performance. 

VII. Conclusions 

Low-complexity soft-decision decoding techniques employing a list of the test error patterns 
for linear binary block codes of small to medium block length were investigated. The optimum 
and suboptimum construction of the list of error patterns was developed. Some properties of 
the joint probability of error of the received bits after ordering were derived. The original OSD 
algorithm was generalized by assuming a segmentation of the MRIPs. The segmentation of the 
MRIPs was shown to overcome several drawbacks of the original OSD and to enable flexibility 
for devising new decoding strategies. The decoding complexity of the OSD-based decoding 
algorithms was reduced further by avoiding the Gauss (or the Gauss Jordan) elimination using 
the partial ordering of the received bits in the POSD decoding. The performance analysis was 
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concerned with the problem of finding the probability of the test error patterns contained in 
the decoding list. The BER performance and the decoding complexity of the proposed decoding 
techniques were compared by extensive computer simulations. Numerical examples demonstrated 
excellent flexibility of the proposed decoding schemes to trade-off the BER performance and 
the decoding complexity. In some cases, both the BER performance as well as the decoding 
complexity of the segmentation-based OSD were found to be improved compared to the original 
OSD. 

Appendix 

We derive the probabilities Pq, Pi and P2 in Section V. Without loss of generality, we assume 
that the all-ones codeword was transmitted, i.e., Xj = — 1 for Vi. Then, after ordering, the i-th 
received bit, i = 1, 2, ■ ■ ■ , A^, is in error, provided that > 0. The probability of bit error Pq 
for the MRIPs is obtained as, 

/»oo /»oo 

Po = / / fu{u\u>V3)f^^{v3)dv3du 
Jo Jo 



where the conditional PDF lfT6ll . 



fu (u) \ 

^ ' U > V3 



fu{u\u > V3) = { '-^-^^''^ 

u < V3 

and fu{u) and Fu{v3) are the PDF and the CDF of the reliability of the received bits, respectively, 
so that. 

Similarly, the probability of bit error Pi for the first segment is calculated as, 

POO POO 

Pi = / / fu{u\u > V2)fv2{v2)dV2du 

Jo Jo 

The probability of bit error P2 for the second segment is calculated as, 

POO POO POO 

P2 = / / / fu{u\vi > u > V3)f^^^y^{vi,V3)dVidv3du 



JO JO JO 

where the conditional PDF, 



fu{u\vi >U>V3)= { P'^M-F^M ^1 ^ ^ ^ ^3 

otherwise 
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and the joint PDF of the order statistics Vi > f 3 is, 





fvs{v3) Vi>V3 



and thus, 




dvdv'du. 



Jo Jo Ju 
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TABLE I 

Implementation Complexity of the OSD and the POSD 



OSD(/i) and 0SD(Ji,/2) 


operation 


complexity 


r 


2N FLOPS 


f 


iVlog2(iV) FLOPS 


Gauss el. G' 


Nmm(K,N - Kf BOPS 


f" 


K + K{N - K) BOPS 


POSD(Ji) = ISD(Ji) 


operation 


complexity 


r 


27V FLOPS 


f 


BOPS 


P0SD(/i,J2) 


operation 


complexity 


r 


2N FLOPS 


f' 


K\og.^{K) FLOPS 



TABLE II 

Decoding List Sizes for the OSD and the POSD 



OSD(J) 


ELo (f ) 


OSD(/i,J2) 


E[io m + Efio (?) 


POSD(/) = ISD(/) 


Ei^o ( I ) 


POSD(7i,/2) 


Efio(1^) + Efio(?) 



0-OSD 



W 



xo 



ro 



argmax 



Fig. 1. The system model and an equivalent vector channel with the binary vector input c and the vector soft-output fo. 
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Fig. 2. The BER of the (31, 16, 7) BCH code over an AWGN channel. 
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Fig. 3. The BER of the (63, 45, 14) BCH code over an AWGN channel. 



IEEE TRANSACTIONS ON INFORMATION THEORY 



21 



DC 
LU 
CD 



BPSK 
^ — 0SD(1) 
^— 0SD(2) 

OSD(2|21 ,2|43) 
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Fig. 4. The BER of the (128, 64, 22) BCH code over an AWGN channel. 
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Fig. 5. The BER of the (31, 16, 7) BCH code over a Rayleigh fading channel. 
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Fig. 6. The BER of the (64, 57, 4) BCH coded over a Rayleigh fading channel. 



